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DETAILED ACTION 
Response to Amendment 

1 . In response to the Advisory Action mailed 3/1 2/09, applicant has submitted an 
amendment filed 4/22/09. 

Claims 1,8, 15, 22, and 32, have been amended. 



Response to Arguments 

1 . Applicant's arguments with respect to claims 1 , 8, 15, 22, 32, 42, and 49, have 
been considered but are moot in view of the new ground(s) of rejection. 



Priority for certain features (i.e., adjusting the size of the bubble and the tail of the 
bubble, the use of a server for the processing) does not have benefit of the 9/30/02 
priority date because they are not described in provisional application 60/414,623. 

Priority of the provisional application relates to translation and presentation of the 
bubble with the original text and the translation. 



Claim Objections 

2. Claim 22 is objected to because of the following informalities: 

Claim 22 recites "the content" in the 3rd to last line which refers to the content of 

the callout but as claimed has no antecedent basis. 

Claim 32, recites "wherein said application comprises" (parallel limitations to 

Claim 22) but does not recite an application in the method claim. 
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Claim 42 contains a typographical error in line 3 ("user"' instead of -user's") and 
also recites "returned from the server" when no previous returning step is recited (line 
10) 

Claim 49 recites "user's computer when no previous recitation of user computer 

is recited (line 10) 

Appropriate correction is required. 

Claim Rejections - 35 USC § 103 

3. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the phor art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

Claims 1, 8, and 15, are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Proszeky et al. ("Context-Sensitive Electronic Dictionaries"), hereafter Proszekyi, 
in view of Proszeky ("Comprehension Assistance Meets Machine Translation"), 
hereafter Proszeky2 

As per Claim 1, 8, 15, Proszekyi teaches/suggests providing a user with 
bilingual annotation on a piece of textual information in a first language contained in an 
electronic document displayed in the user's screen ("provide translations for any piece 
of text displayed on a computer screen... text acquisition from the screen, morpho- 
syntactic analysis of the context of the selected word, dictionary lookup... able to 
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recognize... multi-word expressions on tlie screen", Abstract; "reads text from anywhere 
on the computer screen, performs its linguistic analysis in the background... output is 
displayed in a bubble, in front of the existing screen contents... leaving the mouse 
pointer over the translation point for one second". Introduction, paragraph 4; what is 
contained in the bubble is an annotation for the text analyzed by the translator, it is 
obvious to also include the original text being translated so that the user does not 
mistake the translation of a single word for a translation of an expression, and vice 
versa) 

screen-scraping a segment of text adjacent to, or overlaid by, the user's pointer, 
("text acquisition from the screen... selected word... multi-word expressions". Abstract; 
"context... linguistic analysis... leaving the mouse pointer over the translation point". 
Introduction, paragraph 4; "linguistic analysis". Section 3; where text acquisition is 
scraping a screen for text, and depends on where the mouse is. Linguistic analysis is 
language analysis and analyzing a language based on context requires knowing the 
grammar which defines how words surrounding a word affect its meaning, and so the 
linguistic analysis uses a number of logic/linguistic/grammatical rules to determine the 
meaning of a word [and make logical sense out of it, hence the rules are logical too]) 

said segment's length being automatically adjusted according to one or more 
logic, linguistic, and/or grammatical rules ("text acquisition from the screen... selected 
word... able to recognize... multi-word expressions... morphological analysis". Abstract; 
"idiomatic phrases". Section 3, especially paragraph 4; where being able to recognize a 
single selected word or a multi-word expression for translation adjusts the analysis 
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window lengtli to tlie number of words in the word/expression based on properties 
[rules] of the language being analyzed, which includes linguistic/language rules and any 
grammar rules that define a sequence of words as an expression/phrase/sentence. 
These rules make a sensible/logical decision on what to translate and so they are 
logical in nature as well) 

calibrating said screen-scraped segment of text into a query according to one or 
more logic, linguistic and/or grammatical rules ("acquires text from anywhere", 
Introduction, paragraph 4; "morpho-syntactic analysis of its context to determine what to 
look up in the dictionaries", Section 3, Phase 2; where the morpho-syntactic analysis 
combines a word with context information [calibrating a query] to perform a dictionary 
lookup, and morpho-syntactic [i.e., language/linguistic] analysis performs syntax 
analysis using the rules of a language, which is a form of grammatical analysis since 
syntax deals with, among other things, parts of speech [e.g., verb, noun, etc.] and the 
analysis makes sense out of the word and so is logical in nature as well) 

translate said query into a second language by looking up a database and 
applying a set of logic, linguistic and grammatical rules ("linguistic analysis and 
dictionary lookups... morpho-syntactic analysis". Section 3, Phase 2; where the morpho- 
syntactic analysis and its rules is used to determine the context [linguistic and 
grammatical information] to determine what to logically retrieve from the dictionaries 
[where the context information is somehow mapped to the correct translation, and the 
mapping is a rule of sorts]) 
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display on tlie user's screen a callout containing textual information, comprising 
said query and said query's translation ("bubble". Introduction, paragraph 4; "output of 
the program". Section 3, especially last paragraph; "text acquisition from the screen... 
selected word... multi-word expressions", Abstract; "context... linguistic analysis... 
leaving the mouse pointer over the translation point", Introduction, paragraph 4; where 
the bubble contains the translation information, and when the system can process either 
a single word or a number of words, it is obvious to also include the original text being 
translated so that the user does not mistake the translation of a single word for a 
translation of an expression, and vice versa) 

wherein said callout is dynamically associated with the user's pointer ("reads text 
from anywhere on the computer screen, performs its linguistic analysis in the 
background... output is displayed in a bubble, in front of the existing screen contents... 
leaving the mouse pointer over the translation point for one second", Introduction, 
paragraph 4; where the mouse pointer determines the translation point and the bubble 
is obviously linked to the translation point and so is dynamically associated with the 
mouse pointer depending on where the mouse pointer is). 

Proszekyi fails to teach wherein said callout is adaptive to fit the textual 
information therein, and wherein said callout comprises a tail which approximately 
overlaps with the user's pointer, and where the textual information in the callout includes 
reading aid information. 
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Proszeky2 teaches wherein said callout is adaptive to fit the textual information 
therein (Figures 1 and 3; where the bubbles in Figures 1 and 3 are visibly sized to the 
smallest size that fits all of the relevant information 

and wherein said callout comprises a tail which approximately overlaps with the 
user's pointer (Figures 1 and 3; where the word bubbles have a sharp point sticking out 
of the upper left corner which is a tail that approximately overlaps with the user's pointer 
because they point to the selected word/expression, and as described in Proszekyi , the 
selection depends on placing a mouse on the selected word/expression and so the 
mouse's position would be approximately where the tall Is located/pointing to) 

and where the textual information in the callout includes reading aid Information 
("pop-up bubble... can show much more than just dictionary entries... explanatory", 
Section 2.3, last paragraph; where the explanatory information and other information 
helps the user to understand the text). 

Therefore, it would have been obvious to one of ordinary skill in the art at the 
time of invention to modify Proszekyi to include the teaching of Proszeky2 of wherein 
said callout is adaptive to fit the textual information therein, and wherein said callout 
comprises a tall which approximately overlaps with the user's pointer and where the 
textual Information In the callout Includes reading aid information, In order to provide all 
of the Information needed for a human reader to understand or interpret the text 
displayed on the screen, as described by Proszeky2 (Introduction, paragraph 1). 
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4. Claims 22, 32, 42, and 49, are rejected under 35 U.S.C. 1 03(a) as being 
unpatentable over Proszekyi , in view of Proszeky2 and Scanlan (US 6,857,022) 

As per Claim 22, Proszekyi teaches/suggests a system for providing a user with 
bilingual annotation on a piece of textual information in a first language contained in an 
electronic document, comprising an application which operates to: ("provide translations 
for any piece of text displayed on a computer screen... text acquisition from the screen, 
morpho-syntactic analysis of the context of the selected word, dictionary lookup... able 
to recognize... multi-word expressions on the screen". Abstract; "reads text from 
anywhere on the computer screen, performs its linguistic analysis in the background... 
output is displayed in a bubble, in front of the existing screen contents... leaving the 
mouse pointer over the translation point for one second". Introduction, paragraph 4; 
what is contained in the bubble is an annotation for the text analyzed by the translator, it 
is obvious to also include the original text being translated so that the user does not 
mistake the translation of a single word for a translation of an expression, and vice 
versa) 

screen-scrape a segment of text adjacent to, or overlaid by, the user's pointer, 
("text acquisition from the screen... selected word... multi-word expressions", Abstract; 
"context... linguistic analysis... leaving the mouse pointer over the translation point", 
Introduction, paragraph 4; "linguistic analysis". Section 3; where text acquisition is 
scraping a screen for text, and depends on where the mouse is. Linguistic analysis is 
language analysis and analyzing a language based on context requires knowing the 
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grammar which defines how words surrounding a word affect its meaning, and so the 
linguistic analysis uses a number of logic/linguistic/grammatical rules to determine the 
meaning of a word [and make logical sense out of it, hence the rules are logical too]) 

calibrate said screen-scraped segment of text into a query ("acquires text from 
anywhere", Introduction, paragraph 4; "morpho-syntactic analysis of Its context to 
determine what to look up In the dictionaries". Section 3, Phase 2; where the morpho- 
syntactic analysis combines a word with context information [calibrating a query] to 
perform a dictionary lookup, and morpho-syntactic [i.e., language/linguistic] analysis 
performs syntax analysis using the rules of a language, which Is a form of grammatical 
analysis since syntax deals with, among other things, parts of speech [e.g., verb, noun, 
etc.] and the analysis makes sense out of the word and so is logical in nature as well) 

translate said query into a second language ("linguistic analysis and dictionary 
lookups... morpho-syntactic analysis", Section 3, Phase 2; where the morpho-syntactic 
analysis and Its rules is used to determine the context [linguistic and grammatical 
information] to determine what to logically retrieve from the dictionaries [where the 
context information is somehow mapped to the correct translation, and the mapping is a 
rule of sorts]) 

send a signal to display said query and said query's translation In a callout on the 
user's screen ("bubble". Introduction, paragraph 4; "output of the program", Section 3, 
especially last paragraph; "text acquisition from the screen... selected word... multi-word 
expressions". Abstract; "context... linguistic analysis... leaving the mouse pointer over 
the translation point". Introduction, paragraph 4; where the bubble contains the 
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translation information returned from the translation process, and when the system can 
process either a single word or a number of words, it is obvious to also include the 
original text being translated so that the user does not mistake the translation of a single 
word for a translation of an expression, and vice versa) 

wherein the length of said segment of text is automatically adjusted according to 
one or more logic, linguistic, and/or grammatical rules ("text acquisition from the 
screen... selected word. ..able to recognize... multi-word expressions... morphological 
analysis". Abstract; "idiomatic phrases". Section 3, especially paragraph 4; where being 
able to recognize a single selected word or a multi-word expression for translation 
adjusts the analysis window length to the number of words in the word/expression 
based on properties [rules] of the language being analyzed, which includes 
linguistic/language rules and any grammar rules that define a sequence of words as an 
expression/phrase/sentence. These rules make a sensible/logical decision on what to 
translate and so they are logical in nature as well) 

wherein said callout's position is dynamically associated with the user's pointer 
("reads text from anywhere on the computer screen, performs its linguistic analysis in 
the background... output is displayed in a bubble, in front of the existing screen 
contents... leaving the mouse pointer over the translation point for one second", 
Introduction, paragraph 4; where the mouse pointer determines the translation point and 
the bubble is obviously linked to the translation point and so is dynamically associated 
with the mouse pointer depending on where the mouse pointer is). 
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Proszekyi fails to teach where the callout includes reading aid information, 
wherein said callout comprises a tail which approximately overlaps with the user's 
pointer, and wherein said callout is adaptive to fit the content therein. 

Proszeky2 teaches where the display in the callout includes reading aid 
information ("pop-up bubble... can show much more than just dictionary entries... 
explanatory", Section 2.3, last paragraph; where the explanatory information and other 
information helps the user to understand the text). 

wherein said callout comprises a tail which approximately overlaps with the 
user's pointer (Figures 1 and 3; where the word bubbles have a sharp point sticking out 
of the upper left corner which is a tail that approximately overlaps with the user's pointer 
because they point to the selected word/expression, and as described in Proszekyi , the 
selection depends on placing a mouse on the selected word/expression and so the 
mouse's position would be approximately where the tail is located/pointing to) 

wherein said callout is adaptive to fit the content therein (Figures 1 and 3; where 
the bubbles in Figures 1 and 3 are visibly sized to the smallest size that fits all of the 
relevant information) 

Therefore, it would have been obvious to one of ordinary skill in the art at the 
time of invention to modify Proszekyi to include the teaching of Proszeky2 of where the 
callout includes reading aid information, wherein said callout comprises a tail which 
approximately overlaps with the user's pointer, and wherein said callout is adaptive to fit 
the content therein, in order to provide all of the information needed for a human reader 
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to understand or interpret tine text displayed on the screen, as described by Proszel<y2 
(Introduction, paragrapln 1). 

Proszekyl , in view of Proszeky2, fail to teach where providing the textual 
information is done by returning the information from a web server, where the electronic 
document is a website supported by a web server, wherein said application comprises a 
graphical user interface embedded in each page of said web site, said graphical user 
interface comprising: means for activation or deactivation of said application, and 
means for selecting said second language from a list of languages, wherein said 
application is automatically activated when said second language is selected, and 
wherein said graphical user interface further comprises means for setting parameters of 
said callout. 

Scanlan teaches where providing the textual information is done by returning the 
information from a web server (Figure 6, "processes the request by translating the text... 
transferred to the customer's browser and displayed in the requested language", col. 3, 
lines 32-45; "web page", col. 3, lines 3-13; where Scanlan teaches that the translation is 
done remotely and so the remote location "serves" the customer with the translated 
information) 

where the electronic document is a website supported by a web server ("web 
page... translation", col. 3, lines 1-21; where Scanlan teaches that web pages are being 
translated), 

wherein said application comprises a graphical user interface embedded in each 
page of said web site (Figure 6; "webmaster... can include... to instantaneously enable 
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a one-click translation... another selection of a target language will invoke the process", 
col. 5, lines 45-61 ; where Figure 6 shows the language selection displayed to a user 
and is a banner so it is present for all webpages that it is programmed into) 

said graphical user interface comprising: means for activation or deactivation of 
said application (Figure 6; "webmaster... can include... to instantaneously enable a 
one-click translation... another selection of a target language will invoke the process", 
col. 5, lines 45-61 ; where the "go" button serves to activate a translation process) 

and means for selecting said second language from a list of languages (Figure 6; 
where Figure 6 shows a list of languages to choose from), 

wherein said application is automatically activated when said second language is 
selected (Figure 6; where one of the variations [just above the FIG 6 label] does not 
include a Go button, and so it is automatically activated upon selection), 

and wherein said graphical user interface further comprises means for setting 
parameters of said callout (Figure 6; where the target translation language is a 
parameter of the callout because it determines what language the text in the callout 
becomes, and so selecting a language sets a parameter of the callout. 

Therefore, it would have been obvious to one of ordinary skill in the art at the 
time of invention to modify Proszekyi , in view of Proszeky2, to include the teaching of 
Scanlan of where providing the textual information is done by returning the information 
from a web server, where the electronic document is a website supported by a web 
server, wherein said application comprises a graphical user interface embedded in each 
page of said web site, said graphical user interface comprising: means for activation or 
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deactivation of said application, and means for selecting said second language from a 
list of languages, wherein said application is automatically activated when said second 
language is selected, and wherein said graphical user interface further comprises 
means for setting parameters of said callout, in order to provide an easy method for 
selecting a target translation method, as described by Scanlan (col. 5, lines 45-60; 
where one-click and "all the customer has to do" implies ease of use). 

As per Claim 32, Proszekyi teaches/suggests a method for providing a user with 
bilingual annotation on a piece of textual information in a first language contained in an 
electronic document, comprising the steps of: ("provide translations for any piece of text 
displayed on a computer screen... text acquisition from the screen, morpho-syntactic 
analysis of the context of the selected word, dictionary lookup... able to recognize... 
multi-word expressions on the screen", Abstract; "reads text from anywhere on the 
computer screen, performs its linguistic analysis in the background... output is 
displayed in a bubble, in front of the existing screen contents... leaving the mouse 
pointer over the translation point for one second". Introduction, paragraph 4; what is 
contained in the bubble is an annotation for the text analyzed by the translator, it is 
obvious to also include the original text being translated so that the user does not 
mistake the translation of a single word for a translation of an expression, and vice 
versa) 

screen-scraping a segment of text adjacent to, or overlaid by, the user's pointer, 
("text acquisition from the screen... selected word... multi-word expressions". Abstract; 
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"context... linguistic analysis... leaving the mouse pointer over the translation point", 
Introduction, paragraph 4; "linguistic analysis". Section 3; where text acquisition is 
scraping a screen for text, and depends on where the mouse is. Linguistic analysis is 
language analysis and analyzing a language based on context requires knowing the 
grammar which defines how words surrounding a word affect its meaning, and so the 
linguistic analysis uses a number of logic/linguistic/grammatical rules to determine the 
meaning of a word [and make logical sense out of it, hence the rules are logical too]) 

calibrating said screen-scraped segment of text into a query according to one or 
more rules("acquires text from anywhere", Introduction, paragraph 4; "morpho-syntactic 
analysis of its context to determine what to look up in the dictionaries". Section 3, Phase 
2; where the morpho-syntactic analysis combines a word with context information 
[calibrating a query] to perform a dictionary lookup, and morpho-syntactic [i.e., 
language/linguistic] analysis performs syntax analysis using the rules of a language, 
which is a form of grammatical analysis since syntax deals with, among other things, 
parts of speech [e.g., verb, noun, etc.] and the analysis makes sense out of the word 
and so is logical in nature as well) 

translating said query into a second language by looking up a database and 
applying a set of logic, linguistic, and grammatical rules ("linguistic analysis and 
dictionary lookups... morpho-syntactic analysis". Section 3, Phase 2; where the morpho- 
syntactic analysis and its rules is used to determine the context [linguistic and 
grammatical information] to determine what to logically retrieve from the dictionaries 
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[where the context information is somehow mapped to the correct translation, and the 
mapping is a rule of sorts]) 

returning said query along with said query's translation to the user's screen 
("bubble". Introduction, paragraph 4; "output of the program". Section 3, especially last 
paragraph; "text acquisition from the screen... selected word... multi-word expressions", 
Abstract; "context... linguistic analysis... leaving the mouse pointer over the translation 
point". Introduction, paragraph 4; where the translation is returned from the translation 
process to be displayed in the bubble) 

sending a signal to display a callout containing said query and said query's 
translation ("bubble". Introduction, paragraph 4; "output of the program", Section 3, 
especially last paragraph; "text acquisition from the screen... selected word... multi-word 
expressions". Abstract; "context... linguistic analysis... leaving the mouse pointer over 
the translation point", Introduction, paragraph 4; where the bubble contains the 
translation information returned from the translation process, and when the system can 
process either a single word or a number of words, it is obvious to also include the 
original text being translated so that the user does not mistake the translation of a single 
word for a translation of an expression, and vice versa) 

wherein the length of said segment of text is automatically adjusted according to 
one or more logic, linguistic, and/or grammatical rules ("text acquisition from the 
screen... selected word. ..able to recognize... multi-word expressions... morphological 
analysis". Abstract; "idiomatic phrases". Section 3, especially paragraph 4; where being 
able to recognize a single selected word or a multi-word expression for translation 
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adjusts the analysis window length to the number of words in the word/expression 
based on properties [rules] of the language being analyzed, which includes 
linguistic/language rules and any grammar rules that define a sequence of words as an 
expression/phrase/sentence. These rules make a sensible/logical decision on what to 
translate and so they are logical in nature as well) 

wherein said callout's position is dynamically associated with the user's pointer 
("reads text from anywhere on the computer screen, performs its linguistic analysis in 
the background... output is displayed in a bubble, in front of the existing screen 
contents... leaving the mouse pointer over the translation point for one second", 
Introduction, paragraph 4; where the mouse pointer determines the translation point and 
the bubble is obviously linked to the translation point and so is dynamically associated 
with the mouse pointer depending on where the mouse pointer is). 

Proszekyi fails to teach where the callout Includes reading aid information, 
wherein said callout comprises a tail which approximately overlaps with the user's 
pointer, and wherein said callout is adaptive to fit the content therein. 

Proszeky2 teaches where the display in the callout includes reading aid 
information ("pop-up bubble... can show much more than just dictionary entries... 
explanatory", Section 2.3, last paragraph; where the explanatory information and other 
information helps the user to understand the text). 

wherein said callout comprises a tail which approximately overlaps with the 
user's pointer (Figures 1 and 3; where the word bubbles have a sharp point sticking out 
of the upper left corner which is a tail that approximately overlaps with the user's pointer 
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because they point to tlie selected word/expression, and as described in Proszekyi , the 
selection depends on placing a mouse on the selected word/expression and so the 
mouse's position would be approximately where the tail is located/pointing to) 

wherein said callout is adaptive to fit the content therein (Figures 1 and 3; where 
the bubbles in Figures 1 and 3 are visibly sized to the smallest size that fits all of the 
relevant information) 

Therefore, it would have been obvious to one of ordinary skill in the art at the 
time of invention to modify Proszekyi to include the teaching of Proszeky2 of where the 
callout includes reading aid information, wherein said callout comprises a tail which 
approximately overlaps with the user's pointer, and wherein said callout is adaptive to fit 
the content therein, in order to provide all of the information needed for a human reader 
to understand or interpret the text displayed on the screen, as described by Proszeky2 
(Introduction, paragraph 1). 

Proszekyi , in view of Proszeky2, fail to teach where providing the textual 
information is done by returning the information from a web server, where the electronic 
document is a website supported by a web server, wherein said application comprises a 
graphical user interface embedded in each page of said web site, said graphical user 
interface comprising: means for activation or deactivation of said application, and 
means for selecting said second language from a list of languages, wherein said 
application is automatically activated when said second language is selected, and 
wherein said graphical user interface further comprises means for setting parameters of 
said callout. 
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Scanlan teaches where providing the textual information is done by returning the 
information from a web server (Figure 6, "processes the request by translating the text... 
transferred to the customer's browser and displayed in the requested language", col. 3, 
lines 32-45; "web page", col. 3, lines 3-13; where Scanlan teaches that the translation is 
done remotely and so the remote location "serves" the customer with the translated 
information) 

where the electronic document is a website supported by a web server ("web 
page... translation", col. 3, lines 1-21; where Scanlan teaches that web pages are being 

translated), 

wherein said application comprises a graphical user interface embedded in each 
page of said web site (Figure 6; "webmaster... can include... to instantaneously enable 
a one-click translation... another selection of a target language will invoke the process", 
col. 5, lines 45-61 ; where Figure 6 shows the language selection displayed to a user 
and is a banner so it is present for all webpages that it is programmed into) 

said graphical user interface comprising: means for activation or deactivation of 
said application (Figure 6; "webmaster... can include... to instantaneously enable a 
one-click translation... another selection of a target language will invoke the process", 
col. 5, lines 45-61 ; where the "go" button serves to activate a translation process) 

and means for selecting said second language from a list of languages (Figure 6; 
where Figure 6 shows a list of languages to choose from). 
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wherein said application is automatically activated when said second language is 
selected (Figure 6; where one of the variations [just above the FIG 6 label] does not 
include a Go button, and so it is automatically activated upon selection), 

and wherein said graphical user interface further comprises means for setting 
parameters of said callout (Figure 6; where the target translation language is a 
parameter of the callout because it determines what language the text in the callout 
becomes, and so selecting a language sets a parameter of the callout. 

Therefore, it would have been obvious to one of ordinary skill in the art at the 
time of invention to modify Proszekyi , in view of Proszeky2, to include the teaching of 
Scanlan of where providing the textual information is done by returning the information 
from a web server, where the electronic document is a website supported by a web 
server, wherein said application comprises a graphical user interface embedded in each 
page of said web site, said graphical user interface comprising: means for activation or 
deactivation of said application, and means for selecting said second language from a 
list of languages, wherein said application is automatically activated when said second 
language is selected, and wherein said graphical user interface further comprises 
means for setting parameters of said callout, in order to provide an easy method for 
selecting a target translation method, as described by Scanlan (col. 5, lines 45-60; 
where one-click and "all the customer has to do" implies ease of use). 

As per Claim 42, Proszekyi teaches/suggests a system for providing a real-time 
multilingual annotation to a user, said system comprising: ("provide translations for any 



Application/Control Number: 10/529,087 Page 21 

Art Unit: 2626 

piece of text displayed on a computer screen... text acquisition from tlie screen, 
morplio-syntactic analysis of the context of the selected word, dictionary lookup... able 
to recognize... multi-word expressions on the screen". Abstract; "reads text from 
anywhere on the computer screen, performs its linguistic analysis in the background... 
output is displayed in a bubble, in front of the existing screen contents... leaving the 
mouse pointer over the translation point for one second". Introduction, paragraph 4; 
what is contained in the bubble is an annotation for the text analyzed by the translator, it 
is obvious to also include the original text being translated so that the user does not 
mistake the translation of a single word for a translation of an expression, and vice 
versa) 

(a) a client application which runs on a user's computer, said client application 
being operable to: screen-scrape a segment of text in a first language, said segment of 
text being adjacent to, or overlaid by, the user's pointer, ("text acquisition from the 
screen... selected word... multi-word expressions". Abstract; "context... linguistic 
analysis... leaving the mouse pointer over the translation point". Introduction, paragraph 
4; "linguistic analysis". Section 3; where text acquisition is scraping a screen for text, 
and depends on where the mouse is. Linguistic analysis is language analysis and 
analyzing a language based on context requires knowing the grammar which defines 
how words surrounding a word affect its meaning, and so the linguistic analysis uses a 
number of logic/linguistic/grammatical rules to determine the meaning of a word [and 
make logical sense out of it, hence the rules are logical too]) 
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calibrate said screen-scraped segment of text into a query ("acquires text from 
anywiiere", Introduction, paragraph 4; "morpho-syntactic analysis of its context to 
determine what to look up in the dictionaries", Section 3, Phase 2; where the morpho- 
syntactic analysis combines a word with context information [calibrating a query] to 
perform a dictionary lookup, and morpho-syntactic [i.e., language/linguistic] analysis 
performs syntax analysis using the rules of a language, which is a form of grammatical 
analysis since syntax deals with, among other things, parts of speech [e.g., verb, noun, 
etc.] and the analysis makes sense out of the word and so is logical in nature as well) 

send said query to be translated ("translation point", Introduction, paragraph 4; 
"linguistic analysis". Section 3; where the acquired text is given to the translation 
process to be translated) 

display an annotation callout which contains said query and the translation of 
said query returned from the translation ("bubble", Introduction, paragraph 4; "output of 
the program". Section 3, especially last paragraph; "text acquisition from the screen... 
selected word... multi-word expressions". Abstract; "context... linguistic analysis... 
leaving the mouse pointer over the translation point". Introduction, paragraph 4; where 
the bubble contains the translation information returned from the translation process, 
and when the system can process either a single word or a number of words, it is 
obvious to also include the original text being translated so that the user does not 
mistake the translation of a single word for a translation of an expression, and vice 
versa) 
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(b) a translation application operable to translating said query into a second 
language by looking up a database and applying a set of logic, linguistic, and 
grammatical rules ("linguistic analysis and dictionary lookups... morpho-syntactic 
analysis", Section 3, Phase 2; where the morpho-syntactic analysis and its rules is used 
to determine the context [linguistic and grammatical information] to determine what to 
logically retrieve from the dictionaries [where the context information is somehow 
mapped to the correct translation, and the mapping is a rule of sorts]) 

return the translation of said query to the client application ("bubble". Introduction, 
paragraph 4; "output of the program", Section 3, especially last paragraph; "text 
acquisition from the screen... selected word... multi-word expressions". Abstract; 
"context... linguistic analysis... leaving the mouse pointer over the translation point". 
Introduction, paragraph 4; where the bubble contains the translation information 
returned from the translation process) 

wherein said segment of text is automatically adjusted according to one or more 
logic, linguistic, and/or grammatical rules ("text acquisition from the screen... selected 
word... able to recognize... multi-word expressions... morphological analysis". Abstract; 
"idiomatic phrases", Section 3, especially paragraph 4; where being able to recognize a 
single selected word or a multi-word expression for translation adjusts the analysis 
window length to the number of words in the word/expression based on properties 
[rules] of the language being analyzed, which includes linguistic/language rules and any 
grammar rules that define a sequence of words as an expression/phrase/sentence. 
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These rules make a sensible/logical decision on what to translate and so they are 
logical in nature as well) 

wherein said callout is dynamically associated with the user's pointer ("reads text 
from anywhere on the computer screen, performs its linguistic analysis in the 
background... output Is displayed in a bubble, in front of the existing screen contents... 
leaving the mouse pointer over the translation point for one second". Introduction, 
paragraph 4; where the mouse pointer determines the translation point and the bubble 
is obviously linked to the translation point and so is dynamically associated with the 
mouse pointer depending on where the mouse pointer is). 

Proszekyi fails to teach wherein said callout has a tail which approximately 
overlaps with the user's pointer, and wherein said callout is adaptive to fit the content 
therein. 

Proszeky2 teaches wherein said callout has a tail which approximately overlaps 
with the user's pointer (Figures 1 and 3; where the word bubbles have a sharp point 
sticking out of the upper left corner which is a tail that approximately overlaps with the 
user's pointer because they point to the selected word/expression, and as described in 
Proszekyi , the selection depends on placing a mouse on the selected word/expression 
and so the mouse's position would be approximately where the tail is located/pointing 
to) 

wherein said callout is adaptive to fit the content therein (Figures 1 and 3; where 
the bubbles in Figures 1 and 3 are visibly sized to the smallest size that fits all of the 
relevant information) 
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Therefore, it would have been obvious to one of ordinary skill in the art at the 
time of invention to modify Proszekyi to include the teaching of Proszeky2 of where the 
callout includes reading aid information, wherein said callout comprises a tail which 
approximately overlaps with the user's pointer, and wherein said callout is adaptive to fit 
the content therein, In order to provide all of the information needed for a human reader 
to understand or interpret the text displayed on the screen, as described by Proszeky2 
(Introduction, paragraph 1). 

Proszekyi , in view of Proszeky2, fail to teach where the service is provided over 
a global network from a server to a user, where the query Is sent to the server, where 
the translation application is a server application which runs on the server, where the 
query is returned from the server. 

Scanlan teaches where the service is provided over a global network from a 
server to a user (Figure 1 , "processes the request by translating the text... transferred to 
the customer's browser and displayed in the requested language", col. 3, lines 32-45; 
"web page", col. 3, lines 3-13; where Scanlan teaches that the translation is done 
remotely and so the remote location "serves" the customer with the translated 
information) 

where the query Is sent to the server, where the translation application Is a server 
application which runs on the server, where the query is returned from the server 
((Figure 1 , "processes the request by translating the text... transferred to the customer's 
browser and displayed in the requested language", col. 3, lines 32-45; "web page", col. 
3, lines 3-13; where Scanlan teaches that the translation is done remotely and shows in 
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Figure 1 that documents [i.e., website/translation] is communicated between the 
customer/client and the translation server/manager) 

Therefore, it would have been obvious to one of ordinary skill in the art at the 
time of invention to modify Proszekyi , in view of Proszeky2, to include the teaching of 
Scanlan of where the service is provided over a global network from a server to a user, 
where the query is sent to the server, where the translation application is a server 
application which runs on the server, where the query is returned from the server, in 
order to provide a simple and speedy translation method, as described by Scanlan (col. 
2, lines 4-6). 

As per Claim 49, Proszekyi teaches/suggests a method for providing a real-time 
multilingual annotation to a user, said method comprising: ("provide translations for any 
piece of text displayed on a computer screen... text acquisition from the screen, 
morpho-syntactic analysis of the context of the selected word, dictionary lookup... able 
to recognize... multi-word expressions on the screen". Abstract; "reads text from 
anywhere on the computer screen, performs its linguistic analysis in the background... 
output is displayed in a bubble, in front of the existing screen contents... leaving the 
mouse pointer over the translation point for one second", Introduction, paragraph 4; 
what is contained in the bubble is an annotation for the text analyzed by the translator, it 
is obvious to also include the original text being translated so that the user does not 
mistake the translation of a single word for a translation of an expression, and vice 
versa) 
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screen-scraping a segment of text in a first language, said segment of text being 
adjacent to, or overlaid by, tine user's pointer, ("text acquisition from tine screen... 
selected word... multi-word expressions", Abstract; "context... linguistic analysis... 
leaving the mouse pointer over the translation point". Introduction, paragraph 4; 
"linguistic analysis", Section 3; where text acquisition is scraping a screen for text, and 
depends on where the mouse is. Linguistic analysis is language analysis and analyzing 
a language based on context requires knowing the grammar which defines how words 
surrounding a word affect its meaning, and so the linguistic analysis uses a number of 
logic/linguistic/grammatical rules to determine the meaning of a word [and make logical 
sense out of it, hence the rules are logical too]) 

calibrating said screen-scraped segment of text into a query ("acquires text from 
anywhere". Introduction, paragraph 4; "morpho-syntactic analysis of its context to 
determine what to look up in the dictionaries", Section 3, Phase 2; where the morpho- 
syntactic analysis combines a word with context information [calibrating a query] to 
perform a dictionary lookup, and morpho-syntactic [i.e., language/linguistic] analysis 
performs syntax analysis using the rules of a language, which is a form of grammatical 
analysis since syntax deals with, among other things, parts of speech [e.g., verb, noun, 
etc.] and the analysis makes sense out of the word and so is logical in nature as well) 

send said query to be translated ("translation point". Introduction, paragraph 4; 
"linguistic analysis". Section 3; where the acquired text is given to the translation 
process to be translated) 
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translating said query into a second language by looking up a database and 
applying a set of logic, linguistic, and grammatical rules ("linguistic analysis and 
dictionary lookups... morpho-syntactic analysis", Section 3, Phase 2; where the morpho- 
syntactic analysis and its rules is used to determine the context [linguistic and 
grammatical information] to determine what to logically retrieve from the dictionaries 
[where the context information is somehow mapped to the correct translation, and the 
mapping is a rule of sorts]) 

returning the translation of said query to the user's computer ("bubble". 
Introduction, paragraph 4; "output of the program", Section 3, especially last paragraph; 
"text acquisition from the screen... selected word... multi-word expressions", Abstract; 
"context... linguistic analysis... leaving the mouse pointer over the translation point". 
Introduction, paragraph 4; where the bubble contains the translation information 
returned from the translation process) 

display an annotation callout which contains said query and the translation of 
said query returned from the translation ("bubble". Introduction, paragraph 4; "output of 
the program". Section 3, especially last paragraph; "text acquisition from the screen... 
selected word... multi-word expressions". Abstract; "context... linguistic analysis... 
leaving the mouse pointer over the translation point", Introduction, paragraph 4; where 
the bubble contains the translation information returned from the translation process, 
and when the system can process either a single word or a number of words, it is 
obvious to also include the original text being translated so that the user does not 



Application/Control Number: 10/529,087 Page 29 

Art Unit: 2626 

mistake the translation of a single word for a translation of an expression, and vice 
versa) 

wherein the length of said segment of text is automatically adjusted according to 
one or more logic, linguistic, and/or grammatical rules ("text acquisition from the 
screen... selected word. ..able to recognize... multi-word expressions... morphological 
analysis", Abstract; "idiomatic phrases". Section 3, especially paragraph 4; where being 
able to recognize a single selected word or a multi-word expression for translation 
adjusts the analysis window length to the number of words in the word/expression 
based on properties [rules] of the language being analyzed, which includes 
linguistic/language rules and any grammar rules that define a sequence of words as an 
expression/phrase/sentence. These rules make a sensible/logical decision on what to 
translate and so they are logical in nature as well) 

wherein said callout is dynamically associated with the user's pointer ("reads text 
from anywhere on the computer screen, performs its linguistic analysis in the 
background... output is displayed in a bubble, in front of the existing screen contents... 
leaving the mouse pointer over the translation point for one second". Introduction, 
paragraph 4; where the mouse pointer determines the translation point and the bubble 
is obviously linked to the translation point and so is dynamically associated with the 
mouse pointer depending on where the mouse pointer is). 

Proszekyi fails to teach where the display in the callout includes reading aid 
information, wherein said callout has a tail which approximately overlaps with the user's 
pointer, and wherein said callout is adaptive to fit the content therein. 
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Proszeky2 teaches where the display in the callout includes reading aid 
infornnation ("pop-up bubble... can show much more than just dictionary entries... 
explanatory", Section 2.3, last paragraph; where the explanatory information and other 
information helps the user to understand the text). 

wherein said callout has a tail which approximately overlaps with the user's 
pointer (Figures 1 and 3; where the word bubbles have a sharp point sticking out of the 
upper left corner which is a tail that approximately overlaps with the user's pointer 
because they point to the selected word/expression, and as described in Proszekyi , the 
selection depends on placing a mouse on the selected word/expression and so the 
mouse's position would be approximately where the tail is located/pointing to) 

wherein said callout is adaptive to fit the content therein (Figures 1 and 3; where 
the bubbles in Figures 1 and 3 are visibly sized to the smallest size that fits all of the 
relevant information) 

Therefore, it would have been obvious to one of ordinary skill in the art at the 
time of invention to modify Proszekyi to include the teaching of Proszeky2 of where the 
display in the callout includes reading aid information, where the callout includes 
reading aid information, wherein said callout comprises a tail which approximately 
overlaps with the user's pointer, and wherein said callout is adaptive to fit the content 
therein, in order to provide all of the information needed for a human reader to 
understand or interpret the text displayed on the screen, as described by Proszeky2 
(Introduction, paragraph 1). 
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Proszekyi , in view of Proszeky2, fail to teach where the service is provided over 
a global network from a server to a user, where the query is sent to the server, where 
the translation application is a server application which runs on the server, where the 
query is returned from the server. 

Scanlan teaches where the service is provided over a global network from a 
server to a user (Figure 1 , "processes the request by translating the text... transferred to 
the customer's browser and displayed in the requested language", col. 3, lines 32-45; 
"web page", col. 3, lines 3-13; where Scanlan teaches that the translation is done 
remotely and so the remote location "serves" the customer with the translated 
information) 

where the query is sent to the server, where the translation application is a server 
application which runs on the server, where the query is returned from the server 
((Figure 1 , "processes the request by translating the text... transferred to the customer's 
browser and displayed in the requested language", col. 3, lines 32-45; "web page", col. 
3, lines 3-13; where Scanlan teaches that the translation is done remotely and shows in 
Figure 1 that documents [i.e., website/translation] is communicated between the 
customer/client and the translation server/manager) 

Therefore, it would have been obvious to one of ordinary skill in the art at the 
time of invention to modify Proszekyi , in view of Proszeky2, to include the teaching of 
Scanlan of where the service is provided over a global network from a server to a user, 
where the query is sent to the server, where the translation application is a server 
application which runs on the server, where the query is returned from the server, in 
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order to provide a simple and speedy translation method, as described by Scanlan (col. 
2, lines 4-6). 



Conclusion 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to ERIC YEN whose telephone number is (571 )272-4249. 
The examiner can normally be reached on M-F 7:30-4:00. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Richemond Dorvil can be reached on 571-272-7602. The fax phone 
number for the organization where this application or proceeding is assigned is 571- 
273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 
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